Remote talk down to panel, camera and speaker

ABSTRACT

Methods and systems are described for storing video content collected by a home automation system. According to at least one embodiment, an apparatus for accessing video content collected by a home automation system includes a processor, a memory in electronic communication with the processor, and instructions stored in the memory which are executable by a processor to receive at a remote device live video content from a camera of the home automation system, and initiate real-time, two-way audio communication between the remote device and a user of the home automation system via the camera.

BACKGROUND

Advancements in media delivery systems and media-related technologiescontinue to increase at a rapid pace. Increasing demand for media hasinfluenced the advances made to media-related technologies. Computersystems have increasingly become an integral part of the media-relatedtechnologies. Computer systems may be used to carry out severalmedia-related functions. The wide-spread access to media has beenaccelerated by the increased use of computer networks, including theInternet and cloud networking.

Many homes and businesses use one or more computer networks to generate,deliver, and receive data and information between the various computersconnected to computer networks. Users of computer technologies continueto demand increased access to information and an increase in theefficiency of these technologies. Improving the efficiency of computertechnologies is desirable to those who use and rely on computers.

With the wide-spread use of computers and mobile devices has come anincreased presence of home automation and security products.Advancements in mobile devices allow users to monitor and/or control anaspect of a home or business. As home automation and security productsexpand to encompass other systems and functionality in the home,challenges exist in communicating with the home automation and securityproducts from remote locations.

SUMMARY

Methods and systems are described for storing video content collected bya home automation system. According to at least one embodiment, anapparatus for storing video content collected by a home automationsystem includes a processor, a memory in electronic communication withthe processor, and instructions stored in the memory which areexecutable by the processor to receive at a remote device live videocontent from a camera of the home automation system, and initiatereal-time, two-way audio communication between the remote device and auser of the home automation system via the camera.

In one example, the instructions may be executable by the processor totransmit audio messages from the remote device to the camera. Theinstructions may be executable by the processor to receive audiomessages transmitted from the camera to the remote device. Theinstructions may be executable by the processor to display the livevideo content on the remote device. The remote device may be a portable,handheld device. The instructions may be executable by the processor toconfirm the real-time, two-way audio communication prior to transmittingor receiving audio messages. The camera may be integrated into a controlpanel of the home automation system, and the control panel may includeat least one speaker and at least one microphone for the audiocommunications. The camera may include at least one speaker and at leastone microphone.

Another embodiment of the present disclosure relates to acomputer-program product for remote talk down using a home automationsystem. The computer-program product includes a non-transitorycomputer-readable medium storing instructions executable by a processorto receive real-time video at a computing device located remote from aproperty monitored by the home automation system. The real-time video isgenerated by a camera of the home automation system located at theproperty. The instructions are also executable by the processor totransmit a first audio message from the computing device to the propertybeing monitored by the home automation system, and receive a secondaudio message generated at the property.

In one example, transmitting the first audio message and receiving thesecond audio message may occur in real-time. Transmitting the firstaudio message may include transmitting the first audio message to thecamera. Receiving the second audio message may include receiving thesecond audio message from the camera. The computing device may include amobile, handheld computing device. The instructions may be executable bya processor to initiate a two-way communication channel between thecomputing device and the camera.

Another embodiment of the present disclosure relates to acomputer-implemented method for communicating between a remote, handhelddevice and a home automation system. The method includes initiating atwo-way communication link between the remote, handheld device and acamera of the home automation system, receiving video content from thecamera, and transmitting audio messages from the remote, handheld deviceto the camera in real-time.

In one example, receiving audio messages transmitted from the camera tothe remote, handheld device may occur in real-time. The at least one ofthe audio messages received from the camera may be responsive to atleast one of the audio messages transmitted from the remote, handhelddevice to the camera. The method may include routing the video contentand audio messages through a control panel of the home automationsystem.

A further embodiment of the present disclosure relates to an apparatusfor remote audio communication using a home automation system. Theapparatus includes a processor, a memory in electronic communicationwith the processor, and instructions stored in the memory, wherein theinstructions are executable by the processor to transmit live videocontent from a camera of the home automation system to a remote device,and provide real-time, two-way audio communication between the remotedevice and a user of the home automation system via the camera.

In one example, the real-time, two-way audio communication may occurconcurrently with transmitting the live video content. The instructionsmay be executable by the processor to collect the live video contentwith a camera of the home automation system. The home automation systemmay include at least one speaker and at least one microphone configuredto provide the real-time audio communications from a user of the homeautomation system. The camera may include a microphone and a speaker.The video content and audio communication may be routed through acontrol panel of the home automation system.

The foregoing has outlined rather broadly the features and technicaladvantages of examples according to the disclosure in order that thedetailed description that follows may be better understood. Additionalfeatures and advantages will be described hereinafter. The conceptionand specific examples disclosed may be readily utilized as a basis formodifying or designing other structures for carrying out the samepurposes of the present disclosure. Such equivalent constructions do notdepart from the spirit and scope of the appended claims. Features whichare believed to be characteristic of the concepts disclosed herein, bothas to their organization and method of operation, together withassociated advantages will be better understood from the followingdescription when considered in connection with the accompanying figures.Each of the figures is provided for the purpose of illustration anddescription only, and not as a definition of the limits of the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

A further understanding of the nature and advantages of the embodimentsmay be realized by reference to the following drawings. In the appendedfigures, similar components or features may have the same referencelabel. Further, various components of the same type may be distinguishedby following the reference label by a dash and a second label thatdistinguishes among the similar components. If only the first referencelabel is used in the specification, the description is applicable to anyone of the similar components having the same first reference labelirrespective of the second reference label.

FIG. 1 is a block diagram of an environment in which the present systemsand methods may be implemented;

FIG. 2 is a block diagram of another environment in which the presentsystems and methods may be implemented;

FIG. 3 is a block diagram of another environment in which the presentsystems and methods may be implemented;

FIG. 4 is a block diagram of another environment in which the presentsystems and methods may be implemented;

FIG. 5 is a block diagram of another environment in which the presentsystems and methods may be implemented;

FIG. 6 is a block diagram of a communication module for use in at leastone of the environments shown in FIG. 1-5;

FIG. 7 is a flow diagram illustrating a method for remote audiocommunication using a home automation system;

FIG. 8 is a flow diagram illustrating a method for remote talk downusing a home automation system;

FIG. 9 is a flow diagram illustrating a method for communicating betweena remote-handheld device and a home automation system;

FIG. 10 is a flow diagram illustrating a method for remote audiocommunication using a home automation system; and

FIG. 11 is a block diagram of a computer system suitable forimplementing the present systems and methods of FIGS. 1-10.

While the embodiments described herein are susceptible to variousmodifications and alternative forms, specific embodiments have beenshown by way of example in the drawings and will be described in detailherein. However, the exemplary embodiments described herein are notintended to be limited to the particular forms disclosed. Rather, theinstant disclosure covers all modifications, equivalents, andalternatives falling within the scope of the appended claims.

DETAILED DESCRIPTION

The systems and methods described herein relate to home automation andhome security, and related security systems and automation for use incommercial and business settings. More specifically, the systems andmethods described herein relate to storing video content collected by ahome automation system. As used herein, the phrase “home automationsystem” may refer to a system that includes automation features alone,security features alone, a combination of automation and securityfeatures, or a combination of automation, security and other features.While the phrase “home automation system” is used throughout to describea system or components of a system or environment in which aspects ofthe present disclosure are described, such an automation system and itsrelated features (whether automation and/or security features) may begenerally applicable to other properties such as businesses andcommercial properties as well as systems that are used in indoor andoutdoor settings.

Many home automation systems include video and audio capability. Thevideo capability is usually provided by at least one camera thatgenerates a video feed of a viewing area of the camera. The videocontent may be used for a number of purposes including, for example,occupancy detection and identification of occupant activities. In atleast one example, the camera is used to provide a video feed to aremotely-located user of the home automation system such as, forexample, a parent or home owner. The video content may provide, forexample, a live “look-in” by the parent to see how the family is doingwhen the parent is located remotely. In another example, the homeownermay use the live “look-in” to monitor activities of a pet, confirmparcel or appliance delivery, watch activities of a repairman orinstaller, and the like. The video feed may also be used as part of asecurity system in which unauthorized persons or activities areidentified via the live video feed.

Audio capabilities of the home automation system may be used in avariety of ways. For example, a home automation system may include anintercom function wherein a combination of speakers and microphones areused to convey audio messages throughout a property such as a home.Another audio capability is a speaker system used to project musicthroughout a property or as a sound system for media such as radio,television, gaming systems, and the like. Another capability of theaudio features of a home automation system relates to security featuressuch as a microphone that “listens” for sounds that represent anauthorized entry to a property or a speaker that sounds an alarm relatedto breach of a security measure associated with the property. Thespeakers and microphones of the home automation system may be used tocommunicate with offsite security personnel such as a 911 operator or athird-party security system administrator.

Typically, the audio capabilities of the home automation system areprovided separate from the video capability. That is, the microphone andspeaker associated with audio capability of a home automation systemoperates separately and independently from the cameras and the videofeed provided by the cameras.

One aspect of the present disclosure is related to integration of audioand video capability of a home automation system. In one example,real-time video content that is viewable at a remote location from theproperty being monitored by the home automation system may present to aremote user an opportunity for audio communication with a person locatedat the property. The microphone and speakers may be used in combinationwith the camera, which are all located onsite at the property, toprovide real-time communication with the remote user. The real-timecommunication may include one-way video communication and two-way audiocommunication. The remote user may use a computing device such as ahandheld mobile computing device that includes a display, microphone andspeaker, which enables the two-way audio communication while viewing alive video feed.

Another aspect of the present disclosure relates to integration of audiocapability with a camera of a home automation system. For example, acamera of the home automation system may include at least one microphoneand at least one speaker. An audio signal may be delivered from a remotelocation and projected by the speaker of the camera. A person or otherobject (e.g., a pet or electronic device) may provide an audio responsethat is picked up by the microphone of the camera and transmitted to theremote user.

In at least some cases, the remote user may be located at a differentroom or space of the same property where the camera, microphone andspeaker of the home automation system resides. Additionally, oralternatively, the remote user may be positioned at a location remotefrom the property where the camera, microphone and speaker of the homeautomation system resides.

In some embodiments, the camera includes only one of the microphone orspeaker, and the other of the microphone and speaker not included in thecamera is part of the home automation system as a separate device. Atleast some of the audio capability may be provided by a mobile computingdevice that provides audio communication between the user located on theproperty and a remote user, wherein the video communication is providedby the camera. In one example, both the local and remote users mayoperate an app on a handheld computing device that provides at least oneof the audio and video communication.

At least some of the systems and methods disclosed herein may bereferred to as remote talk-down systems or methods. A remote talk-downsystem that provides two-way audio communication, at least one-way videocommunication, and is associated with a home automation system is anadvance in this technical field. Furthermore, providing an integratedcamera with audio capability (e.g., microphone and speaker) may helpfacilitate the real-time, two-way audio communication with a remotelocation where the live video feed from the camera is viewed. The personviewing the live video feed at the remote location may participate in areal-time, two-way audio communication with a person or object locatedat the camera. The term “two-way communication” may refer tocommunication that includes listening to audio (e.g., via a speaker) andgenerating an audio message (e.g., a microphone). The term “real-time”may include relatively instantaneous communications, with expected briefdelays associated with transmission of the electronic signal over any ofa variety of communication mediums (e.g., wired or wireless). Forexample, a telephone conversation conducted over a wired or wirelesssystems typically provides real-time audio communication, although briefdelays may occur depending upon, for example, the distance betweenpersons participating in the call and the technology used (e.g.,satellite, wireless, fiber optic, etc.).

FIG. 1 is a block diagram of one embodiment of environment 100 in whichthe present systems and methods may be implemented. In some embodiments,the systems and methods described herein may be performed, at least inpart, using a camera 105, which communicates with a remote device 115via a network 110. The remote device 115 may include a communicationmodule 120, or communication module 120 may be operated at least in partusing remote device 115. Typically, camera 105 is located locally suchas at a property monitored by a home automation system. The homeautomation system may be part of or include environment 100.

Remote device 115 is typically located remotely relative to camera 105.The remote location may be, for example, another room of a building fromwhere the camera 105 is located. Alternatively, the remote location maybe a location remote from the property being monitored by the homeautomation system and wherein camera 105 resides. In one example, camera105 is located at a user's home and the remote device 115 is located ata user's place of business that is separate from the user's home. Instill further examples, remote device 115 is a mobile device such as ahandheld mobile device, a tablet computing device, or the like, whichmay be located at any number of locations that are remote relative tocamera 105.

Communication module 120 may facilitate communication of video and audiocontent between camera 105 and remote device 115. For example,communication module 120 may facilitate receipt and display of videocontent generated by camera 105 on the remote device 115. Communicationmodule 120 may provide two-way audio communication between camera 105and remote device 115. In at some examples, camera 105 and remote device115 each include components necessary for two-way audio communicationsuch as, for example, at least one microphone and at least one speaker.Communication module 120 may facilitate real-time, two-way audiocommunication and real-time, one-way video communication using thecomponents of camera 105 and remote device 115. In other examples,communication module 120 may facilitate video communication betweencamera 105 and remote device 115, and may facilitate audio communicationbetween remote device 115 and at least one other device separate fromcamera 105 (e.g., a microphone and/or speaker positioned in closeproximity to camera 105, such as within the same room as camera 105).

In one embodiment, camera 105 is located at a user's home and isoperable to provide a live video feed to remote device 115 showing oneor more persons positioned in the home. Environment 100 may also includeaudio capability via at least one microphone and at least one speaker ofcamera 105 to provide real-time, two-way audio communication between theone or more users at the home and the user of remote device 115 (e.g.,via communication module 120). The remote user may view the personswithin the viewing area of camera 105 via the real-time video feed whileconcurrently talking to the persons shown in the video feed andlistening to audio responses from the persons via the remote device 115.The audio and video content may be delivered over network 110. Network110 may include wired or wireless communication mediums. In at least oneexample, network 110 includes the Internet.

Communication module 120 is shown in FIG. 1 as a component of remotedevice 115. In other examples, communication module 120 may be carriedby or operable using a separate component from remote device 115, butmay be in communication with remote device 115 to provide itsfunctionality to the user of remote device 115. In other examples,camera 105 may include a separate communication module or related moduleand/or functionality. Alternative embodiments including at least some ofthe components of environment 100 are described below with references toFIGS. 2-6.

FIG. 2 shows another environment 200 that may include the components ofenvironment 100 described above, and may further include a device 205, acamera 105-a including a controller 210, a microphone 215 and a speaker220. Environment 200 also includes a remote device 115-a having, inaddition to communication module 120, a display 225, a microphone 230,and a speaker 235.

Device 205 may be in direct communication with camera 105-a.Additionally or alternatively, device 205 may also be in directcommunication with network 110, which provides electronic communicationwith both camera 105-a and remote device 115-a. Device 205 may include,for example, a control panel of the home automation system. In otherexamples, device 205 may include other types of electronic devices suchas, for example, a desk top computer, a lap top computer, a tabletcomputer or a handheld mobile device such as a smart phone.

Controller 210 may provide logic for camera 105-a to permit camera 105-ato operate independently of other devices such as a control panel of thehome automation system (e.g., communicate directly with remote device115-a via network 110). Controller 210 may provide logic for operating amicrophone 215 and speaker 220 as a part of providing real-time, two-wayaudio communication with remote device 115-a. In some examples, camera105-a additionally includes a communication module (e.g., communicationmodule 120) that assists in providing and/or facilitating at least oneof the video and audio communication with remote device 115-a.

Microphone 215 may include at least one microphone that collects audiocontent from one or more persons or objects in proximity to camera105-a. For example, a person standing in front of or within a viewablearea of camera 105-a may generate an audio message that is collected bymicrophone 215 and delivered to remote device 115-a. Speaker 220includes at least one speaker device that conveys an audio message fromremote device 115-a to, for example, a person within the viewable areaof camera of 105-a.

Microphone 215 and speaker 220 may be integrated into a common housingof camera 105-a. Additionally or alternatively, microphone 215 andspeaker 220 may be dedicated to camera 105-a, but may be positionedoutside of a housing of camera 105-a (e.g., mounted adjacent to or inrelative close proximity to the housing of camera 105-a). Microphone 215and speaker 220 may be dedicated solely to providing audiocommunications in connection with camera 105-a alone. Alternatively,microphone 215 and speaker 220 may have additional functionalityseparate from providing audio communications in connection with camera105-a. For example, microphone 215 and speaker 220 may provide at leastsome audio functionality for a home automation system of environment 200such as, for example, providing intercom functionality, sounding analarm, speaking voice commands, etc.

Display 225 may provide display of at least some of the video contentreceived from camera 105-a. Display 225 may provide a real-time displayof video content from camera 105-a. Display 225 may be integrated into ahousing of remote device 115-a. Display 225 may include, for example, atouch screen.

Microphone 230 may include at least one microphone device operable toconvey an audio message provided by a user of remote device 115-a to,for example, speaker 220 of camera 105-a. Speaker 235 may include atleast one speaker device and may project an audible message to the userof remote device 115-a from, for example, microphone 215 of camera105-a. Microphone 230 and speaker 235 may facilitate real-time, two-wayaudio communication between the user of remote device 115-a and one ormore persons or objects associated with camera 105-a (e.g., viamicrophone 215 and speaker 220). Microphone 230 and speaker 235 may behoused within a common housing of remote device 115-a along with display225. Alternatively, at least one of display 225, microphone 230 andspeaker 235 may be positioned outside of the housing of remote device115-a, while remaining in operational connection with other componentsof remote device 115-a.

Communication module 120 may provide communication between display 225,microphone 230 and speaker 235 with the components of camera 105-a(e.g., microphone 215 and speaker 220). Communication module 120 mayprovide communication between any of the components of remote device115-a and other devices and systems, such as, for example, device 205.Network 110 facilitates communication between camera 105, remote device115-a, and device 205, or other components of environment 200. Network110 may include local area networks (LAN), wide-area networks (WAN),virtual private networks (VPN), wireless networks (using 802.11, forexample) and/or cellular networks (using 3G and/or LTE, for example),etc. In some embodiments, network 110 may include the Internet.

FIG. 3 shows another environment 300 that may include the components ofenvironments 100, 200, described above, and may further include a device205-a having camera 105, microphone 215 and speaker 220. In at least oneexample, device 205-a may be a control panel of a home automationsystem. Camera 105, microphone 215 and speaker 220 are shown ascomponents of device 205-a, and may be included in a common housing ofdevice 205-a. The camera 105, microphone 215 and speaker 220 may havemany different functions and purposes. One such function may be toprovide a video feed to remote device 115-a and provide two-wayreal-time audio communication between device 205-a and remote device115-a. Other functions include, for example, providing face recognitionusing camera 105, providing voice recognition using microphone 215, andprojecting an alarm or other indicators associated with automation orsecurity features of the home automation system with which device 205-ais associated.

Device 205-a may represent at least one control panel of the homeautomation system. In one embodiment, device 205-a may represent othertypes of electronic devices associated with a home automation system.Device 205-a may be a single, permanently wall-mounted device.Alternatively, device 205-a may be a portable device, and/or may includea plurality of devices (e.g., control panels), wherein each controlpanel includes at least one of camera 105, microphone 215, and speaker220. In some arrangements, camera 105, microphone 215 and speaker 220may be positioned outside of a housing of device 205-a, but may bededicated to or specifically associated with device 205-a.

Remote device 115-a may receive video content from camera 105 inreal-time. Remote device 115-a may facilitate real-time, two-way audiocommunication with device 205-a. The audio communication between remotedevice 115-a and device 205-a may be referred to as remote talk-down todevice 205-a (e.g., control panel), camera 105, or speaker 220.

FIG. 4 shows another environment 400 that may include the components ofenvironments 100, 200, 300 described above, and may further includedevice 205, camera 105, microphone 215 and speaker 220 provided asseparate and distinct components of environment 400 and/or a homeautomation system. Device 205, camera 105, microphone 215 and speaker220 may separately communicate with remote device 115-a via network 110.Device 205, camera 105, microphone 215 and speaker 220 may communicatedirectly with each other separate from communication via network 110.Device 205, camera 105, microphone 215 and speaker 220 may, in someembodiments, communicate directly with any one of communication module120, display 225, microphone 230 and speaker 235 of remote device 115-avia network 110 or other communication means.

While device 205, camera 105, microphone 215, and speaker 220 are shownas separate components, at least some of these components may beintegrated into a single housing, may be located in close proximity toeach other or remote from each other, and generally may provide theremote talk down from remote device 115-a to one or more usersassociated with device 205, camera 105, microphone 215, and/or speaker220.

FIG. 5 shows another environment 500 that may include the components ofenvironments 100, 200, 300, 400 described above, and may further includean application 505, a display 510, a sensor 515, and a user interface520. Camera 105-a may include the same or similar configuration as shownin FIG. 2 with reference to environment 200, but may, in otherembodiments, have other configurations as shown in FIGS. 1, 3, and 4.Application 505, display 510, sensor 515, and user interface 520 may beused with any of the environments 100, 200, 300, 400 described herein.

Application 505 may allow a user (e.g., a user within the field of viewof camera 105-a or the remote user of remote device 115-a), to controleither directly or via device 205 or controller 210, an aspect of themonitored property, including security, energy management, locking andunlocking doors, checking the status of a door, locating a user or item,controlling lighting, thermostat, or cameras, and receivingnotifications regarding a current status or anomaly associated with ahome, office, place of business, and the like. In some configurations,application 505 may enable device 205 and/or camera 105-a to interfacewith controller 210 and/or remote device 115-a and provide the userinterface 520 to display an automation, security, and/or energymanagement content on device 205 and/or remote device 115-a. Thus,application 505 via user interface 520 may allow users to controlaspects of their home, office, and/or other type of property. Further,application 505 may be installed on device 205, camera 105-a, and/orremote device 115-a.

Display 510 may include, for example, a digital display as part of, forexample, a control panel of environment 500 (e.g., a home automationsystem). Display 510 may be provided via devices such as, for example, adesktop computer or a mobile computing device (e.g., remote device115-a). The user interface 520 may be integrated into display 510. Sucha user interface 520 may include a plurality of menus, screens,microphones, speakers, cameras, and other capability that permitinteraction between the user and the home automation system or anycomponent of environment 500. Additionally, or alternatively, the userinterface 520 with display 510 may be integrated into camera 105-a,device 205, and/or remote device 115-a.

Sensor 515 may include, for example, a camera sensor, an audio sensor, aforced entry sensor, a shock sensor, a proximity sensor, a boundarysensor, an appliance sensor, a light fixture sensor, a temperaturesensor, a light beam sensor, a three-dimensional (3D) sensor, a motionsensor, a smoke sensor, a glass break sensor, a door sensor, a videosensor, a carbon monoxide sensor, an accelerometer, a global positioningsystem (GPS) sensor, a Wi-Fi positioning sensor, a capacitance sensor, aradio frequency sensor, a near-field sensor, a heartbeat sensor, abreathing sensor, an oxygen sensor, a carbon dioxide sensor, a brainwavesensor, a motion sensor, a voice sensor, a touch sensor, and the like.The camera 105-a may include video and still-shot images and may be partof or integrated into one or more of sensors 515. Camera 105-a may haveincluded or have integrated therein one or more of the sensors 515.Similarly, remote device 115-a and/or device 205 may include or haveintegrated therein one or more of the sensors 515. Although sensor 515is depicted as a separate component from camera 105, device 205, andremote device 115-a. In some embodiments, sensor 515 may be connecteddirectly to any one of those components or other components ofenvironment 500. Additionally, or alternatively, sensor 515 may beintegrated into a home appliance or fixture such as a lightable fixture.The information provided by sensor 515 may be used to generate oridentify an event for the purpose of operating camera 105-a or acomponent thereof, device 205, or remote device 115, or a componentthereof.

In one example, remote device 115-a receives a notification when camera105-a identifies a person within a viewable area covered by camera 105-abased on a motion sensor 515. The user of remote device 115-a may, inreal-time, send an audio message via microphone 230 and speaker 220 tothe person within the viewable area of camera 105-a. The user of remotedevice 115-a may receive audio feedback from the person within theviewing area of camera 105-a via microphone 215 and speaker 235.

FIG. 6 is a block diagram illustrating an example communication module120-a. Communication module 120-a may be one example of thecommunication module 120 shown in any of FIGS. 1-5. Communication module120-a may include a link connection module 605, a video module 610, anaudio module 615, and a display module 620.

Link connection module 605 may operate to create at least one of a videolink and an audio link between, for example, a remote device (e.g.,remote device 115 shown in FIG. 1-5) and a camera, microphone, and/orspeaker located at, for example, a property monitored by a homeautomation system. One function of communication module 120-a is tocreate a communication link or a connection whereby video and/or audiodata is transmitted between a remote device (e.g., remote device 115shown in FIGS. 1-5) and another device such as a camera (e.g., camera105 shown in FIGS. 1-5). The communication link or channel provided bylink connection module 605 may be tested and/or confirmed prior toattempting to transmit video or audio data across the link/connection.

Video module 610 may operate to provide transmission of video contentbetween the remote device (e.g., remote device 115) and the camera(e.g., camera 105), which is located remote from the remote device.Video module 610 may provide real-time communication of video content.

Audio module 615 may provide audio communication between a remote deviceand audio features located at a separate location (e.g., a propertymonitored by home automation system). Audio module 615 may providereal-time, two-way communication between a remote device and the localaudio components. For example, audio module 615 may providecommunication between a microphone of the remote device and a speaker ofthe local device/system, or provide communication between a microphoneof the local device/system and a speaker of the remote device. The videomodule 610 and audio module 615 may operate to provide real-time videoand audio communication concurrently.

Display module 620 may provide display of video content at a remotedevice. The video content may be generated by a camera located remotefrom the remote device (e.g., locally at a property monitored by a homeautomation system).

Video module 610 may cooperate with display module 620 to display thevideo content. Video module 610, audio module 615, and display module620 may cooperate with link connection module 605 to provide andmaintain reliable video and audio communication. While the audiocommunication provided by audio module 615 is typically two-waycommunication, video communication via video module 610 is typicallyone-way communication (e.g., from camera 105 to remote device 115).Additionally, or alternatively, the video provided by video module 610may be two-way communication. As discussed in detail throughout, thevideo content is typically provided by a camera of a home automationsystem, which may include automation and security features. The audiocomponents associated with the camera may be integrated into a commonhousing of the camera, provided as dedicated audio components associatedonly with a specific camera, or provided as audio components associatedonly with other features of a home automation system in addition to thecamera.

Communication module 120-a may include more or fewer modules in otherembodiments. As discussed above, communication module 120-a may be partof a remote device (e.g., remote device 115) or other components ordevices of a home automation system (e.g., camera 105 or device 205). Inat least some examples, communication module 120-a may include aseparate module or facilitate storing at least some of the video and/oraudio content communicated between the remote device and the camera orother components of the home automation system.

FIG. 7 is a flow diagram illustrating one embodiment of a method 700 forremote audio communication using a home automation system. In someconfigurations, the method 700 may be implemented with any of thecommunication modules 120 shown in FIGS. 1, 2, 3, 4, 5, and/or 6. Insome examples, method 700 may be performed generally by remote device115, camera 105, controller 210, or device 205 shown in FIGS. 1-5, oreven more generally by the environments 100, 200, 300, 400, 500 shown inFIGS. 1-5.

At block 705, method 700 includes receiving at a remote device livevideo content from a camera of a home automation system. Block 710includes initiating real-time, two-way audio communication between aremote device and a user of the home automation system via the camera.

Other steps of method 700 may include transmitting audio messages fromthe remote device to the camera. Method 700 may include receiving audiomessages transmitted from the camera to the remote device, anddisplaying the video content on the remote device. The remote device maybe a portable, handheld device. Method 700 may include confirming thereal-time, two-way audio communication prior to transmitting orreceiving audio messages. The camera may be integrated into a controlpanel of the home automation system, and the control panel may includeat least one speaker and at least one microphone for the audiocommunications. The camera may include at least one speaker and at leastone microphone.

FIG. 8 is a flow diagram illustrating one embodiment of a method 800 forremote talk down using a home automation system. In some configurations,the method 800 may be implemented by any one of the communicationmodules 120 described with reference to FIGS. 1-5. In other examples,method 800 may be performed generally by remote device 115, camera 105,and/or device 205 described with reference to FIGS. 1-5, or even moregenerally by the environments 100, 200, 300, 400, 500 shown in FIGS.1-5.

At block 805, method 800 includes receiving real-time video at acomputing device located remote from a property that is monitored by thehome automation system. The real-time video is generated by a camera ofthe home automation system that is located at the property. At block810, the method 800 includes transmitting a first audio message from thecomputing device to the property being monitored by the home automationsystem. Block 815 includes receiving a second audio message generated atthe property.

Method 800 may also include transmitting the first audio message andreceiving the second audio message in real-time. Transmitting the firstaudio message may include transmitting the first audio message to thecamera. Receiving the second audio message may include receiving thesecond audio message from the camera. The computing device may include amobile, handheld computing device. The method 800 may include initiatinga two-way communication channel between the computing device and thecamera.

FIG. 9 is a flow diagram illustrating one embodiment of a method forcommunicating between a remote, handheld device and a home automationsystem. In some configurations, the method 900 may be implemented by anyone of the communication modules 120 described with reference to FIGS.1-5. In other examples, method 900 may be performed generally by any ofremote device 115, camera 105, and/or device 205, or even more generallyby the environments 100, 200, 300, 400, 500 shown in FIGS. 1-5.

At block 905, the method 900 includes initiating a two-way communicationbetween the remote, handheld device and a camera of the home automationsystem. Block 910 includes receiving video content from the camera.Block 915 includes transmitting audio messages from the remote, handhelddevice to the camera in real-time.

Method 900 may also include receiving audio messages from the camera tothe remote, handheld device in real-time. Method 900 may include routingthe video content and audio messages through a control panel of the homeautomation system. At least one of the audio messages received from thecamera may be responsive to at least one of the audio messagestransmitted from the remote, handheld device.

FIG. 10 is a flow diagram illustrating one embodiment of a method 1000for remote audio communication using a home automation system. Themethod 1000, in some configurations, may be implemented by any one ofthe communication modules 120 described with reference to FIGS. 1-5. Inother examples, method 1000 may be performed generally by any one ofremote device 115, camera 105, and device 205 shown in FIGS. 1-5, oreven more generally by the environments 100, 200, 300, 400, 500 shown inFIGS. 1-5.

At block 1005, the method 1000 includes transmitting live video contentfrom a camera of the home automation system to a remote device. Block1010 includes providing real-time, two-way audio communication betweenthe remote device and a user of the home automation system via thecamera.

The method 1000 may also include providing the real-time, two-way audiocommunication concurrently with transmitting the live video content. Themethod 1000 may include collecting the live video content with a cameraof the home automation system. The home automation system may include atleast one speaker and at least one microphone configured to provide thereal-time audio communications from a user of the home automationsystem. The camera may include a microphone and a speaker. The videocontent and audio communication may be routed through a control panel ofthe home automation system.

FIG. 11 depicts a block diagram of a controller 1100 suitable forimplementing the present systems and methods. The controller 1100 may bean example of the controller 210 of camera 105 or the remote device 115,device 205, and/or camera 105 illustrated in FIGS. 1, 2, 3, 4 and/or 5.In one configuration, controller 1100 includes a bus 1105 whichinterconnects major subsystems of controller 1100, such as a centralprocessor 1110, a system memory 1115 (typically RAM, but which may alsoinclude ROM, flash RAM, or the like), an input/output controller 1120,an external audio device, such as a speaker system 1125 via an audiooutput interface 1130, an external device, such as a display screen 1135via display adapter 1140, an input device 1145 (e.g., remote controldevice interfaced with an input controller 1150), multiple USB devices1165 (interfaced with a USB controller 1170), and a storage interface1180. Also included are at least one sensor 1155 connected to bus 1105through a sensor controller 1160 and a network interface 1185 (coupleddirectly to bus 1105).

Bus 1105 allows data communication between central processor 1110 (e.g.,controller 210) and system memory 1115, which may include read-onlymemory (ROM) or flash memory (neither shown), and random access memory(RAM) (not shown), as previously noted. Communication module 120-b,which is one example of communication module 120 shown in FIGS. 1-5, maybe stored in system memory 1115. Any of the modules discloses withreference to FIGS. 1-5 may be stored in system memory 1115. The RAM isgenerally the main memory into which the operating system andapplication programs are loaded. The ROM or flash memory can contain,among other code, the Basic Input-Output system (BIOS) which controlsbasic hardware operation such as the interaction with peripheralcomponents or devices. Applications (e.g., application 505) residentwith controller 1100 are generally stored on and accessed via anon-transitory computer readable medium, such as a hard disk drive(e.g., fixed disk 1175) or other storage medium. Additionally,applications can be in the form of electronic signals modulated inaccordance with the application and data communication technology whenaccessed via interface 1185.

Storage interface 1180, as with the other storage interfaces ofcontroller 1100, can connect to a standard computer readable medium forstorage and/or retrieval of information, such as a fixed disk drive1175. Fixed disk drive 1175 may be a part of controller 1100 or may beseparate and accessed through other interface systems. Network interface1185 may provide a direct connection to a remote server via a directnetwork link to the Internet via a POP (point of presence). Networkinterface 1185 may provide such connection using wireless techniques,including digital cellular telephone connection, Cellular Digital PacketData (CDPD) connection, digital satellite data connection, or the like.In some embodiments, one or more sensors (e.g., motion sensor, smokesensor, glass break sensor, door sensor, window sensor, carbon monoxidesensor, and the like) connect to controller 1100 wirelessly via networkinterface 1185.

Many other devices or subsystems (not shown) may be connected in asimilar manner (e.g., entertainment system, computing device, remotecameras, wireless key fob, wall mounted user interface device, cellradio module, battery, alarm siren, door lock, lighting system,thermostat, home appliance monitor, utility equipment monitor, and soon). Conversely, all of the devices shown in FIG. 11 need not be presentto practice the present systems and methods. The devices and subsystemscan be interconnected in different ways from that shown in FIG. 11. Theaspect of some operations of a system such as that shown in FIG. 11 arereadily known in the art and are not discussed in detail in thisapplication. Code to implement the present disclosure can be stored in anon-transitory computer-readable medium such as one or more of systemmemory 1115 or fixed disk 1175. The operating system provided oncontroller 1100 may be iOS®, ANDROID®, MS-dOS®, MS-WINDOWS®, OS/2®,UNIX®, LINUX®, or another known operating system.

Moreover, regarding the signals described herein, those skilled in theart will recognize that a signal can be directly transmitted from afirst block to a second block, or a signal can be modified (e.g.,amplified, attenuated, delayed, latched, buffered, inverted, filtered,or otherwise modified) between the blocks. Although the signals of theabove described embodiment are characterized as transmitted from oneblock to the next, other embodiments of the present systems and methodsmay include modified signals in place of such directly transmittedsignals as long as the informational and/or functional aspect of thesignal is transmitted between blocks. To some extent, a signal input ata second block can be conceptualized as a second signal derived from afirst signal output from a first block due to physical limitations ofthe circuitry involved (e.g., there will inevitably be some attenuationand delay). Therefore, as used herein, a second signal derived from afirst signal includes the first signal or any modifications to the firstsignal, whether due to circuit limitations or due to passage throughother circuit elements which do not change the informational and/orfinal functional aspect of the first signal.

While the foregoing disclosure sets forth various embodiments usingspecific block diagrams, flowcharts, and examples, each block diagramcomponent, flowchart step, operation, and/or component described and/orillustrated herein may be implemented, individually and/or collectively,using a wide range of hardware, software, or firmware (or anycombination thereof) configurations. In addition, any disclosure ofcomponents contained within other components should be consideredexemplary in nature since many other architectures can be implemented toachieve the same functionality.

The process parameters and sequence of steps described and/orillustrated herein are given by way of example only and can be varied asdesired. For example, while the steps illustrated and/or describedherein may be shown or discussed in a particular order, these steps donot necessarily need to be performed in the order illustrated ordiscussed. The various exemplary methods described and/or illustratedherein may also omit one or more of the steps described or illustratedherein or include additional steps in addition to those disclosed.

Furthermore, while various embodiments have been described and/orillustrated herein in the context of fully functional computing systems,one or more of these exemplary embodiments may be distributed as aprogram product in a variety of forms, regardless of the particular typeof computer-readable media used to actually carry out the distribution.The embodiments disclosed herein may also be implemented using softwaremodules that perform certain tasks. These software modules may includescript, batch, or other executable files that may be stored on acomputer-readable storage medium or in a computing system. In someembodiments, these software modules may configure a computing system toperform one or more of the exemplary embodiments disclosed herein.

The foregoing description, for purpose of explanation, has beendescribed with reference to specific embodiments. However, theillustrative discussions above are not intended to be exhaustive or tolimit the invention to the precise forms disclosed. Many modificationsand variations are possible in view of the above teachings. Theembodiments were chosen and described in order to best explain theprinciples of the present systems and methods and their practicalapplications, to thereby enable others skilled in the art to bestutilize the present systems and methods and various embodiments withvarious modifications as may be suited to the particular usecontemplated.

Unless otherwise noted, the terms “a” or “an,” as used in thespecification and claims, are to be construed as meaning “at least oneof.” In addition, for ease of use, the words “including” and “having,”as used in the specification and claims, are interchangeable with andhave the same meaning as the word “comprising.” In addition, the term“based on” as used in the specification and the claims is to beconstrued as meaning “based at least upon.”

What is claimed is:
 1. An apparatus for remote audio communication usinga home automation system, comprising: a processor; a memory inelectronic communication with the processor; and instructions stored inthe memory, the instructions being executable by the processor to:receive live video content from a camera of the home automation system;and initiate real-time, two-way audio communication with a user of thehome automation system via the camera.
 2. The apparatus of claim 1,wherein the instructions are executable by the processor to: transmitaudio messages to the camera.
 3. The apparatus of claim 2, wherein theinstructions are executable by the processor to: receive audio messagestransmitted from the camera.
 4. The apparatus of claim 1, wherein theinstructions are executable by the processor to: display the live videocontent.
 5. The apparatus of claim 1, wherein the apparatus is aportable, handheld device.
 6. The apparatus of claim 1, wherein theinstructions are executable by the processor to: confirm the real-time,two-way audio communication prior to transmitting or receiving audiomessages.
 7. The apparatus of claim 1, wherein the camera is integratedinto a control panel of the home automation system, the control panelincluding at least one speaker and at least one microphone for the audiocommunications.
 8. The apparatus of claim 1, wherein the camera includesat least one speaker and at least one microphone.
 9. Acomputer-implemented method for communicating between a remote, handhelddevice and a home automation system, comprising: initiating a two-waycommunication link between the remote, handheld device and a camera ofthe home automation system; receiving video content from the camera; andtransmitting audio messages from the remote, handheld device to thecamera in real-time.
 10. The method of claim 9, further comprising:receiving audio messages transmitted from the camera to the remote,handheld device in real-time.
 11. The method of claim 10, wherein atleast one of the audio messages received from the camera are responsiveto at least one of the audio messages transmitted from the remote,handheld device to the camera.
 12. The method of claim 9, furthercomprising: routing the video content and audio messages through acontrol panel of the home automation system.
 13. The method of claim 9,further comprising: receiving the audio message from the camera inreal-time.
 14. The method of claim 9, wherein initiating the two-waycommunication link includes operating a app on the remote, handhelddevice.
 15. An apparatus for remote audio communication using a homeautomation system, comprising: a processor; a memory in electroniccommunication with the processor; and instructions stored in the memory,the instructions being executable by the processor to: transmit livevideo content to a remote device; and provide real-time, two-way audiocommunication between the remote device and a user of the homeautomation system.
 16. The apparatus of claim 15, wherein the real-time,two-way audio communication occurs concurrently with transmitting thelive video content.
 17. The apparatus of claim 15, wherein theinstructions are executable by the processor to: collect the live videocontent with a camera of the home automation system.
 18. The apparatusof claim 15, wherein the home automation system includes at least onespeaker and at least one microphone configured to provide the real-timeaudio communications from a user of the home automation system.
 19. Theapparatus of claim 17, wherein the camera comprises a microphone and aspeaker.
 20. The apparatus of claim 15, wherein the video content andaudio communication are routed through a control panel of the homeautomation system.